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Abstract 

We give the first two-dimensional pictorial presentation of Berele's correspon- 
dence [B], an analogue of the Robinson- Schensted (R-S) correspondence [Ri, Se] for 
the symplectic group 5|?(2n, C). From the standpoint of representation theory, the 
R-S correspondence combinatorially describes the irreducible decomposition of the 
tensor powers of the natural representation of GL{n,C). Berele's insertion algo- 
rithm gives the bijection that describes the irreducible decomposition of the tensor 
powers of the natural representation of Sp{2n,C). Two-dimensional pictorial pre- 
sentations of the R-S correspondence via local rules (first given by S. Fomin [Fl, F2]) 
and its many variants have proven very useful in understanding their properties and 
creating new generalizations. We hope our new presentation will be similarly useful. 



1 Introduction 



Our purpose is to give a new presentation of Berele's correspondence. 

Berele's correspondence is a combinatorial construction devised by A. Berele in [B], as an 
Sp{2n, C)-analogue of one aspect of the Robinson-Schensted correspondence, or the R-S 
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correspondence for short. The R-S correspondence describes the irreducible decomposition 
of the representation of the group GL{n, C) on (C")*^-^ (where / is a fixed positive integer) 
derived from its natural action on the column vectors of C"'. 

Similarly, Berele's correspondence describes the irreducible decomposition of the repre- 
sentation of the group Sp{2n, C) on (C^")®'^ also derived from its natural action on the 
column vectors in C^", at least on the character level. A further analysis of Berele's cor- 
respondence was conducted by S. Sundaram in her thesis [Sunl]. (See also [Sun2] and 
[Sun3, Theorem 3.10 and Appendix].) 

While many interesting connections have been found between the R-S correspondence 

and various algebraic and geometric objects, the appearance of Berele's correspondence 
has been relatively limited. We show in this article that one more aspect of the R-S 
correspondence has its counterpart for Berele's correspondence. 

S. Fomin [Fl, F2] showed that the R-S correspondence can be presented as a two- 
dimensional inductive application of "local rules", which are based on the properties 
of Young's lattice V (the poset of all partitions, ordered by containment of diagrams) as a 
"Y-graph" or "differential poset" [Stal]. T. Roby [Ry] generalized this interpretation to 
several variants of the R-S correspondence. The local rules can be derived directly from 
the original procedural definition of the R-S correspondence given in [Se] or [Kl] (first 
appearance in [Ri]), as lucidly explained in [vL] by M. van Leeuwen. It is this type of 
analysis that we apply to Berele's correspondence in this article. 

Another important ingredient of Berele's correspondence is Schiitzenberger's jeu de taquin 
or sliding algorithm [Siil]. Fomin, and later van Leeuwen, gave a local rules presentation 
of this algorithm. A widely available treatment of Fomin's local rules approach to the 
R-S correspondence and jeu de taquin can be found in Section 7.13 of [Sta2, Section 
7.13, Appendix 1]. We have been inspired by their work to extend the set of local rules 
and create a "stratification" of the diagram that allows Berele's correspondence to be 
presented pictorially. 

The local rules thus extended turn out to have interesting symmetries. We think that 
the procedure defined by these local rules are of intrinsic interest and deserves more 
investigation. It would also be interesting to connect our algorithm with a poset invariant 
like the Greene-Kleitman correspondence ([Gl] or [G2]), with geometric or Lie group 
theoretic objects like flags or their generalizations, or with a precise interpretation in 
terms of a quantum analogue of Sp{2n, C); all these still remain to be explored. 

In Section 2 we review Berele's original approach to his correspondence via bumping and 
jeu de taquin. In Section 3 we describe the extended set of local rules and the stratification 
of the diagram necessary to present Berele's algorithm pictorially. In Section 4 we describe 
the procedures to handle the reverse correspondence. This is more complicated than the 
original R-S case, where one of the most satisfying aspects of the pictorial description 
is the transparentness of bijectivity. Finally in Section 5 we make some remarks and 
mention directions for future research. 

The authors are grateful to the Japan Society for Promotion of Science for supporting 
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Figure 1: A Diagram and a Tableau 
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• = square (1,3) 
(a) The Young diagram of A = (4, 3, 3, 1) 



3 1 8 

1 9 9 

6 5 2 
5 



r(i,3) = 8 

(b) A tableau of shape (4, 3, 3, 1) 



the first author's postdoc at the University of Tokyo. We thank the departments at 
the University of Tokyo and MIT for their hospitality. We particularly benefited from 
conversations with Sergey Fomin, Kazuhiko Koike, and Marc van Leeuwen. 



2 Review of Berele's Correspondence by Insertion 

Throughout this article, an interval [i,j] will be taken inside the ordered set Z of integers. 
2.1 Partitions 

A partition A is a weakly decreasing sequence of nonnegative integers A = (Ai, A2, A3, . . .), 
Ai > A2 > A3 > ■ ■ ■ with only a finite number of nonzero terms (called the parts of A). 
The number of parts of A is called the length of A and is written /(A). The sum of all the 
parts of A is called the weight of A, and denoted by |A|. In writing concrete partitions, 
we generally suppress trailing zeros. Moreover, in the figures below, we sometimes omit 
parentheses and commas. Since no parts greater than 9 occur in any of the examples, no 
confusion should result. The unique partition of weight is denoted by or 0. The set 
of all partitions will be denoted by V. 

The (Young) diagram of a partition A is formally the set Dx = { (^, j) G | 1 < i < 
^(A), 1 < i < Aj }, which is sometimes identified with A itself. Each G -Da is called 
its squeire or cell, and we may visualize Da as a cluster of contiguous square boxes, each 
representing a "square" arranged in a matrix-like order. (See Figure 1(a).) 

Define a partial order C on partitions by /i C A if and only if C Dx- This turns V 
into a distributive lattice, called Young's lattice. We say that "A covers /x" and write 

AD/ior/iCAif/iCA and they differ by exactly one square. We call such a square a 
corner of A and a cocorner of fi (following van Leeuwen). If the difference lies in the 

k k 

kth row, then we also write A D or C A. 
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Example 2.1. The Young diagram of A = (4, 3, 3, 1), shown in Figure 1(a), has 3 corners 
and 4 cocorners, corresponding to the following covering relations. 



corner 


covering relation 


(1,4) 


A D (3,3,3,1) 


(3,3) 


Ad (4,3,2,1) 


(4,1) 


Ad (4,3,3) 



CO corner 


covering relation 


(1,5) 


A C (5,3,3,1) 


(2,4) 


Ac (4,4,3,1) 


(4,2) 


Ac (4,3,3,2) 


(5,1) 


Ac (4, 3, 3, 1,1) 



2.2 Tableaux 



There are many different conventions for defining "tableaux" . In this article, a tableau 
of shape A, with X eV, formally means an arbitrary map from D\ to a fixed set F, which 
we call the alphabet, and whose elements are the letters. A tableau T of shape A is 
visualized as the same cluster of square boxes as Dx with each box containing the 
value T(i,j) of the map T at {i.j). Thus T{i,j) is also called the entry or content of 
the square {i.j). (See Figure 1(b).) The shape of a tableau T will sometimes be denoted 
by sh(T). For each 76/^, let 771^(7) denote the number of occurrences ("multiplicity") 
of the letter 7 in the tableau T. 

If r' is a totally ordered set, a tableau T is called semistandard or column strict if it 
satisfies the following two conditions: 

1. T{i, 1) < T{i, 2) < • • • < T{i, A^) for 1 < i < where / = 1{X), 

2. T{l,j) < T{2,j) < ■ ■ ■ < T{X'j,j) for 1 < j < Ai, where A^- denotes the length of 
the jth column of A. 

Fix a positive integer n, and let Fn denote the totally ordered set{l<i<2<2< 
■ ■ • < n < n}. A semistandard tableau T of shape A, with entries from r„, is called 
an 5p(2n)-tableau or an n-symplectic tableau if it satisfies an additional condition, 
called the symplectic condition: 

(3) T{i,j) >ifoTl<i<l,l<j <Xi. 

The sum of the weight monomials of T, defined by 

mr (1) -mr (1) mr (2) -my (2) mr (n) -mr (n) 

Xi ^2 • • • X„ , 

for all S'p(2n)-tableaux T of a given shape A, equals the character Xsp{2n) of the irreducible 
representation of Sp{2n, C) labeled by A (see [KT] and a survey in [Sun3]). 
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2.3 (Ordinary) row insertion 



To define Berele insertion we first need to define "(ordinary) row insertion" in the sense 
of Scliensted and Knuth. The description we give here will be somewhat informal; a more 
formal version can be found in [Kl]. 

Given a semistandard tableau T of shape A and a letter 7, we determine a new tableau 
denoted by T <— 7 as follows. First "insert" 7 into the first row of T, which means to 
replace by 7 the leftmost letter 7' in the first row which is strictly larger than 7 (if such 7' 
exists), in which case 7' is said to get "bumped" by 7; or put 7 at the end of the first row 
if no such 7' exists. As long as a letter gets bumped from one row, we similarly insert that 
letter into the next row. At some iteration, the bumped letter will come to rest at the 
end of the next row (possibly creating a new row at the bottom). The resulting object is 
a semistandard tableau (which is denoted by T ^ 7), whose shape covers A. An example 
of this procedure is contained in Example 2.2 of Berele insertion below. 

2.4 Jeu de taquin (sliding algorithm) 

To define Berele insertion we also need the notion of a jeu de taquin slide, due originally to 
Schiitzenberger. Define a punctured shape to be a pair (A, h), where A is a partition and 
h e Dx (called the hole), and its diagram to be Dx \ {h}. Define a punctured tableau 
of shape (A, h) to be a pair (T, h) where T is a map Dx \ {h} F. It represents a filling 
of the squares of A except for the "hole" h, which is left blank. It is called semistandard 
if it satisfies the inequalities (1) and (2) given in the above definition of semistandard 
tableau, in which the hole is to be skipped. 

A (backward) slide is a transformation ^ : (T, h) 1— > (T', h') between punctured tableaux. 
For a fixed A, it is a bijection from the set of semistandard punctured tableaux (T, h) such 
that h is not a corner of A, to the set of those with h ^ (1, 1). It is defined as follows. 
Compare the contents of the two squares of T that are below and to the right oih = 
If T(2+l, j) < T(2, j + 1) (or if (z, j + 1) ^ Dx), then set T'it,j) = T(2 + l, j), h' = (^ + 1, j), 
and set T' to be identical to T elsewhere. Otherwise set T'{i,j) = T(i, j + 1), h' = (i, j + 1), 
and set T' to be identical to T elsewhere. Informally, we simply shde the smaller of these 
two letters (or the one below if they are equal) into the hole h and make the vacated 
square the new hole. T' is again a semistandard punctured tableau. 

Given a semistandard punctured tableau (T, h), one can repeat slides until the hole comes 
to rest at a corner of the shape A. At this point one can just forget the hole and consider 
T' to be a semistandard tableau of shape sh(T') \ h'. We use this procedure below. 

2.5 Berele insertion and Berele's correspondence 

Berele insertion is an explicitly given bijection from the set of pairs (T, 7), where T is 
an 5'p(2n)-tableau of a given shape A, and 7 e r„, to the set of 5*^(2^) -tableau whose 
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shape either covers A or is covered by A (in the poset V). If the ordinary row insertion 
of 7 into T yields a vaUd S'p(2n)-tableau, then it is also the result of the Berele insertion 
of 7 into T by definition. In this case the resulting shape covers A. On the other hand, 
if the result of the row insertion violates condition (3), then it must be that, for some 
A;, a letter k that was in row A; in T was bumped by a letter k. Find the earliest such 
occurrence, and at this point erase both the k and k that are involved in this bumping, 
leaving the position formerly occupied by the as a hole. After this, apply the sliding 
algorithm until the hole moves to a corner, and then forget the hole. This is by definition 
the result of the Berele insertion, and in this case the resulting shape is covered by A. Let 
T ^ 7 denote the result of the Berele insertion of 7 into T. 

B 

Example 2.2. Example of Berele insertion Berele insertion of 1 into the following 
S'p(2n)-tableau T proceeds as follows, producing T ^ 1 &X, the end. In the bumping 

phase, the caption on the arrow means: 

bump: 



1122 1112 1112 

2234_ 2234_ 2224 

1 into row 1 o s ^ 2 into row 2 ^ ^ ^ 3 into row 3 

> 



7^ = 3 3 4 - — ^ 3 3 4 ^ ^ 3 3 4 

4 4 4 2 at (1,3) 4 4 4 3 at (2,3) ^ ^ 

5 5 5 5 5 5 



Placing 3 in row 4 would cause a violation, so cancel 3 and 3 and proceed to the sliding 
phase. 
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lower 4 < right 4 
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move lower 4 up 
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= r^i. 

move 4 left ^ 7 ^ 



lower 5 > right 4 
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4 




5 


5 





The weighted enumerative identity following from this bijection represents the decompo- 
sition of the tensor product of the irreducible representation \sp{2n) of Sp{2n, C) labeled 
by A and the natural representation. 

Berele's correspondence, as we call it in this article, is a bijection from the set of words 
w — W1W2 ■ ■ - Wf in the alphabet r„ of fixed length / to the set of pairs (P, Q), where P 
is an S'p(2n)-tableau of some shape A, and Q is an n-symplectic up-down tableau of 
degree / with initial shape and final shape A; namely Q = {0 = k^'^\ . . . , /t'--'^^ = A), 
g < n, and for each i either k^*"^) C k*^*-' or k,^'-^^^ i) k^^^ holds. (In the 

literature, / is generally called the length oi Q. In this article, we call it the degree 
in order to avoid any association with the length of each k^'^\) If w is such a word, 
then for < i < / put Pi — (• • • ((0 ^ wi) <r- W2) ^ • • •) ^ '^i^ '^^^^ be the 
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shape of Pi. Put P = P/ and Q = {k'^^\ k^^\ . . . , n^f^) . Then, by definition, Berele's 
correspondence takes w to this pair {P,Q). Following the convention for the Robinson- 
Schensted correspondence, we call P and Q the (Berele) P-symbol and Q-symbol of w 

respectively. 

Example 2.3. Applying Berele insertion to the word w = 31233112312232122312 yields 
the following sequence Pi of symplectic tableaux: 
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Berele's correspondence takes the word w to the pair {P,Q), where P is the tableau 
and Q is the following: 



2 2 



(0, 1, 11, 21, 31, 32, 321, 221, 222, 322, 321, 331, 33, 43, 431, 421, 42, 52, 62, 52, 53). 

The enumerative identity following from the whole Berele correspondence represents the 
decomposition of the /-fold tensor product of the natural representation of Sp{2n). For 
more information about related matters, we refer the interested reader to [Sun3], which 
includes a nice survey and an interesting connection between up-down tableaux and stan- 
dard tableaux. 



2.6 Standardization of R-S Correspondence 

In order to give a pictorial interpretation, we introduce a "standardized" version of the 
Berele correspondence. Before discussing standardization of the Berele correspondence, 
let us include a brief summary of the situation for the R-S correspondence. 

In Schensted's original paper, he is interested in enumerating the number of permutations 
with a certain fixed length of longest increasing subsequence. To generalize this to words 
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with repeated entries, in Part II of his paper, he mapped such a word to a permutation (in 

a natural way), appUed his insertion algorithm to this permutation, and then mapped the 
resulting entries of the P symbol back. However, he provides neither a formal definition 
of standardization nor a proof that it commutes with insertion. 

Schiitzenberger [Sii2] not only defined standardization of semistandard tableaux, but also 
showed the validity of a commutative diagram like Figure 2 below for semistandard 
tableaux by using the sliding algorithm to explicate Schensted insertion. To general- 
ize to the symplcctic case, we prefer to have a lemma and a proof that directly compare 
semistandard and standardized insertion. Standardization of shifted tableaux was given 
by B. Sagan in [Sa]. Our approach is most similar to his. 

Definition 2.4. Let w — WiW2- ■ -Wf be a word in the alphabet F = [l,n] of length 
/. The R-S correspondence for multiset permutations takes w to a pair (P, Q) where P 
is a semistandard tableau of the same weight as w, and Q is a standard tableau of the 
same shape as P. The standardization w — wiW2 ■ ■ -Wf is the word obtained from 
w by replacing, for each 7 e P, the occurrences of the letter 7 in ty by the symbols 
7i, 72, ■ ■ ■ , Imwi-y) from left to right, where m.w^'y) is the number of such occurrences. Let 
Pyj denote the totally ordered set li < I2 < ■ ■ ■ < lm„(i) < 2i < 22 < • • • < 2„j^(2) < ■ ■ ■ < 
n-i < n2 < ■ ■ ■ < nm^(^n)- By the standardization P of P we mean a standard tableau 
with entries from instead of [1, /], obtained from P by replacing the occurrences of 
each letter 7 in P (which form a horizontal strip) by 71, 72, ... , Jmpi-y) from left to right. 

We now give a direct proof that standardization commutes with Schensted insertion that 
we will later generalize to the symplectic case. 

Lemma 2.5. Let w — wiw^- • - Wf be a word in P — [l,n] of length f, and let w — 
W\W2 ■ ■ - Wf be its standardization. Let P*^*^ denote the tableau obtained by inserting wi, 
W2, . . . , Wi into the empty tableau, and let P*^*) be the standardization of P^'^\ Then, for 
each i, the insertion of wi into p(*^i) follows exactly the same route as that of Wi into 
P^^~^\ and the resulting tableau coincides with P^^\ 

Proof. We compare the insertion of Wi into p('~^) (the standardized case) with that of Wi 
into p(*~^) (the unstandardized case). We will show the following claim holds row by row 
along with the insertion; then the Lemma follows immediately. 

We define one technical notion. Let T be a semistandard tableau of shape A in the 
alphabet P = [l,n], and let A; e P be a letter. For r > 1, let c+(A;,r) and c_{k,r) be 



defined by: 



c_(A;,r) =max{0}U{i | T{r,j) <k}, 

fmin{A^_i + l}U{j I T(r- l,j) > ^} if r > 2, 
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Roughly c_(fc, r) gives the rightmost column of row r containing entries < k, while c+{k, r) 
gives the leftmost column of the previous row with entries > k. The semistandardness 
guarantees that c+{k, r) — c_{k, r) > 1. Let us say that T has a fc-gap between rows r — 1 
and r if in fact c+{k,r) — C-^{k,r) > 2. 

Claim. Suppose the bumping is about to reach row r in both the standardized and 
unstandardized cases. Suppose the intermediate tableau T of the standard case at this 
point is obtained from the intermediate tableau T of the unstandardized case by modified 
standardization in the following sense (inductive hypothesis). 

1. Let k G [l,n] be the letter bumped from row r — 1 (or /c = Wj if r = 1) in the 
unstandardized case. Then the letter bumped from row r — 1 in the standardized 
case is kg with some index s. 

2. For each k' ^ k, the k' with various indices in T occupy the same positions as the 
k' in T, which form a horizontal strip, and their indices increase from left to right. 

3. The k with various indices in T occupy the same positions as the k in T, which 
form a horizontal strip, and are indexed as follows. The k in rows r and below are 
indexed from 1 to s — 1 from left to right, and those in rows r — 1 and above are 
indexed from left to right starting with s + 1. This together with (2) assures that 
T is semistandard, and we further assume that T has a k-gap between rows r — 1 
and r. 

Then the following hold. 

(a) The insertion terminates at row r in the standardized case if and only if it terminates 
at row r in the unstandardized case. 

(b) If the bumping continues, then the bumping at row r occurs at the same position for 
both cases, and the intermediate tableaux after bumping from row r satisfy (l)-(3) 
above with r replaced by r + 1. 

First note that the insertion terminates at row r in the unstandardized case if and only 
if all entries in row r of T are at most k. Since k with indices greater than s cannot exist 
in row r by assumption, this is equivalent to saying that all entries in row r of T are less 
than kg, precisely in which case the insertion terminates here in the standard case. Hence 
(a). 

Now suppose the bumping continues. Let the conditions (l)-(3) claimed in (b) for the 
new intermediate tableaux be written as (l)*-(3)*, as opposed to the conditions (l)-(3) 
for T and T in the assumption. Let k* be the letter bumped by k from row r of T in 
the unstandardized case. It is the leftmost letter greater than k in this row. Since again 
by assumption T contains no k with indices greater than s in row r of T, the bumped 
letter in the standardized case is also a k*, more precisely k* with the smallest index in 
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with ordinary R-S correspondence 

(P,Q) 

P=standardization of P 

Q=Q 



this row. Since the indices of k* increase from left to right in a row by assumption, it is 
also the leftmost k* in this row of T. So the bumping occurs at the same position in both 
cases, and (1)* also follows. Let t be the index of this k*. The only difference to the k* in 
T (resp. T) caused by this bumping is that it loses k^ (resp. the k* in the same position), 
so that (3)* follows from the assumption (2) apphed to k' — k*. 

Since no letters other than k or k* move during this bumping in row r, (2)* for those other 
letters follows from the assumption (2). Now let us concentrate on the letters k. We know 
that the letters k form a horizontal strip in T and T, and the only change caused during 
this step was an addition of ks into row r, immediately to the right of column c^{r,k). 
Because of the /c-gap between rows r — 1 and r in T, this is still to the left of the column 
c+(r, /c), so that the letters k still form a horizontal strip after this addition. All other 
k in row r have smaller indices, and so do those in rows below. Those in row r — 1 and 
higher have indices larger than s by assumption (3), so (2)* also holds for k. □ 

This lemma shows the validity of the commutative diagram in Figure 2. 
2.7 Standardized Berele's correspondence 

Let w be a word inr„ = {l<l<2<2<---<n< n}. Let be defined as in Def. 2.4, 
but with r — replaced by and ord — > [1,/] be the unique order-preserving 
bijection. 

Now we can define standardized Berele's correspondence for standardized words. In 
standardized Berele insertion, all our bumping and slides occur according to the usual 
rules (though in this case all letters are distinct). Violations of the symplectic condition 
are determined by ignoring the subscripts of the symbols 7^. The only point that needs 
careful consideration is the handling of cancellation. 

A violation occurs exactly when kg {1 < k < n, s being any index) tries to bump k^ 
(t again being any index) out of the kth row, say from the cell {k,c). First put the kg 
at {k,c), which action does not yet cause a violation, and throw the kt away instead of 
inserting it into the next row. Note that now the tableau contains fc's in cells {k, l)-{k, c), 
because letters smaller than k cannot appear in this row due to the symplectic condition, 
and kt must have been the smallest k in this row (therefore the leftmost) in order to be 



Figure 2: Standardization commutes 



R-S 

w > 



standardization 



W > 

R-S 
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bumped. Now remove the k in the cell {k, 1), which is the smallest k in the tableau, and 
is kg if and only if c = 1, and move this hole by the sliding algorithm.^ Note that if c > 1, 
then the hole continues to move to the right up to {k,c). Therefore, if we discard the 
subscripts, this amounts to the same thing as cancelling kg with kt and making {k, c) the 
initial hole for the sliding algorithm. It turns out that removing the smallest k enables 
easier consistent handling. 

This insertion will be denoted by <— . 

B 

Example 2.6. (Example of cancellation) Suppose 82 has been bumped from the 2nd 
row, and is about to be inserted into the 3rd row. In this example it bumps 3i, which 
cannot be placed in row 4. So 3i is removed, and in cancellation the smallest 3, which 
in this case is 3i, is removed. Note that all letters in row 4 must be > 4, assuring that 
the sliding proceeds sideways until the hole comes to the position previously occupied 
by 3i. Compare this to the 3-3 cancellation between the third and fourth tableaux in 
Example 2.2. 



ll I2 ii 23 

2i 2i 22 42 

3i 3i 43 

4i 42 4i 

5i 5i 



insert ^2 iiilo row 3 
> 

remove 3i 



ll 


I2 


ll 


23 


ll 


I2 


ll 23 


2i 


2i 


22 


42 


2i 


2i 


22 42 


3i 


32 


43 


remove 3i 
> 




32 


43 


4i 


42 


4i 




4i 


42 


4i 


5i 


5i 






5i 


5i 





ll 12 ll 23 

2i 2i 22 42 



4i>32 q A 

> 32 43 

move 32 . < ^ 

4i 42 4i 



5i 5 



Given a standardized word w — W1W2 ■ ■ -Wf, put Pi — {• • • ((0 <— Wi) <— W2) • • • ) 

B B B B 

Wi, and = sh{Pi) for < i < /. Put P = Pf and Q = n^f^). Stan- 

dardized Berele's correspondence takes w to the pair (P, Q), and the terms P-symbol and 
Q-symbol will be used as in the original Berele's correspondence. 

Then it is possible to define standardization of 5'p(2n)-tableaux, in a limited sense: 

Lemma 2.7. Let w = W1W2 ■ ■ - Wf be a word of length f in the alphabet F^, and w ~ 
WiW2- ■ - Wf be its standardization. Suppose w corresponds to {P,Q) by Berele's corre- 
spondence, and w to (P, Q) by standardized Berele 's correspondence. For each 7 e P„, 

let 0^(7) be the number of letters 7 removed in cancellation during the process of Berele's 
correspondence applied to the word w. Note that c^{k) = Cu,{k) for any k e [l,n], and 
that E,gr„^U7)=2ELi^Ufe)= / - I MP) I ■ 

^The authors are grateful to K. Koike for raising the question of which subscripted k should be 
considered cancelled by k in this situation. 
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Then we have Q — Q, and P is obtained from P by replacing, for each 7 e F^, the 

occurrences of the letter j in P by the letters 7c„(7)+i; 7c„(7)+2; ■ ■ ■ ; 7m„(7) in this order 
from left to right. {Note that this makes sense since they form a horizontal strip in P.) 

Proof. One proves this by induction on /, starting with the trivial case where f — 0. Now 
suppose / > 0; then by the induction hypothesis the lemma holds for w — W1W2 ■ ■ ■ 

The standardization of w is W1W2 ■ ■ -W/-!- For simplicity put P = P{w) and P = P{iD). 
A similar result for ordinary row insertion (see Lemma 2.7) assures that the bumping 

phase of P <— Wf proceeds along exactly the same route as that of P <— w/; moreover, if 

cancellation is not involved, the lemma holds for w as well, and if cancellation is involved, 
it occurs at exactly the same timing as it occurs in P ^ Wf. In the latter case suppose 

the cancellation is for the pair k-k. Then the offending k that is bumped and removed 
must be the smallest (leftmost) k in P, since it is the leftmost k in the kth row due to the 
rule of bumping, and because of semistandardness any k to the left of this k must be in a 
row below, which is prohibited by the symplectic condition. The next instruction by the 
standardized Berele insertion is to remove the smallest k, whose subscript matches that 
of the k just removed. So the requirement for the subscripts of A-'s and A;'s remaining in P 
is fulfilled. As stated above, the sliding in the standardized version continues to move to 
the right until it moves the k that has just bumped the k, and after this point the sliding 
follows exactly the same route as in the original version. The left-to-right increasing order 
of the subscripts of each letter is preserved under each step of sliding. Therefore, in this 
case also, the lemma holds for iw. □ 

Example 2.8. For w in Example 2.3, we have 

w = 31I1213231I1I22133I222223223I3232434I325. 

The set is the set of subscripted letters in the upper row of the following table. The 
table describes the ordinal function for this w. 



It 


ll 


I2 


I3 


ll 


I2 


I3 


2i 


22 


23 


24 


25 


2i 


22 


23 


3i 


32 


3i 


32 


33 


34 


ord(7t) 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


20 



The table in Figure 3 describes the proceedure of standardized Berele's correspondence for 
the word w in a step-by-step manner. The whole procedure starts with an empty tableau, 
which is omitted from the table. Each line describes Berele insertion of one letter. The 
field (A) lists the letters involved in the bumping phase, excluding the inserted letter Wj, 
which is written in the leftmost field. If the symplectic condition is violated, the offending 
letter, which is at the end of the list and is underlined, gets removed and sliding starts. 
The field (B) lists the letters involved in the sliding phase, if any. The first letter, also 
underlined, gets removed in cancellation, and the rest get moved. 
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Figure 3: A detailed example of standardized Berele insertion 



Wi 


(A) 


(B) 




sli(P,) 


3i 






3i 


(1) 


li 


3i 




li 
3i 


(1,1) 


2i 






ll 2i 
3i 


(2,1) 


Q 






ll 2i 32 
3i 


(3, ij 


3i 


32 




ll 2i 3i 

3i 32 


(3,2) 


II 


2i.3i 




ll ll 3i 

2i 32 

;-!i 


(3.2. 1) 


h 


li 


li, I2, 3i 


I2 3i 
2i 32 
3i 


(2,2,1) 


2i 


3i, 32 




I2 2i 
2i 3i 
3i 32 


(2,2,2) 


33 






I2 2i 33 
2i 3i 
3i 32 


(3,2,2) 


h 


2i,2i 


2i, 3i, 32 


I2 I2 33 
3i 32 

3i 


(3,2,1) 


% 


33 




I2 I2 22 
3i 32 33 
3i 


(3,3,1) 


22 


22, 3i, 3i 




I2 I2 22 
22 32 33 


(3,3) 


32 






I2 I2 22 32 
22 32 33 


(4,3) 


% 


32, 32 




I2 I2 22 23 
22 32 33 

32 


(4,3,1) 


is 


22, 22 


22, 32, 33 


12 12 13 23 

32 33 

32 


(4,2,1) 


23 


23, 32, 32 


32 


12 12 13 23 
23 33 


(4,2) 


24 






12 12 13 23 24 

23 33 


(5,2) 


34 






12 12 13 23 24 34 

23 33 


(6,2) 


Is 




l2.1:5.1:i.2,.2i.3i 


l:i l:i 2;i 2i .3 1 
2:i 33 


(5.2) 


25 


34 




I3 I3 23 24 26 
23 33 34 


(5,3) 
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Figure 4: Standardization commutes with Berele 's correspondence 
w ^ > {P,Q) 



standardization 



Lemma 2.7 



w . (p,g) 

standardized Berele 



Remark 2.9. (1) Let the 2n-tuple of integers (^«;(7))7er„ be called the literal weight 

of w. If we fix the literal weight of w for example, then Lemma 2.7 gives the operation 
(P, Q) I— » (P, Q) which makes the following diagram commute, since we can determine 
the Cy^i'y) by comparing the given m^(7) and the number of symbols 7 remaining in P. 

It should be possible to determine the 01^,(7) from the pair {P,Q) alone. The sum 
Yyk=i '^w{k) equals the number of shrinks (k^*"^^ D in the sequence Q, but the prob- 
lem is how to "distribute" this sum among various /c's. In principle it is possible since 
we can run Berele's correspondence backwards to find w. Unfortunately we have not yet 
found a direct method, which would be extremely useful. The same problem occurs when 
we try to reverse our pictorial presentation, as discussed in §3. 

(2) Unlike the ordinary case, we cannot construct standardized Berele's correspondence 
(i.e., the map along the bottom row of Figure 4 by replacing w by a permutation 

1 2 ■•• / 

ord(u'i) ord(w2) ■•• oidiwf] 

For it is essential to know what each letter was before standardization in order to detect 
violations of the symplectic condition correctly. 

We could however regard iZ; as a weighted permutation, as in [SS]. 



3 Berele's Correspondence by Local Rules 
3.1 Picture of w 

Next we explain our pictorial approach, which is a two-dimensional presentation of Berele's 
algorithm based on a modified set of local rules in the spirit of Fomin. We draw an / x / 
lattice as in Example 3.1. We employ the matrix coordinate system, and the vertices are 
labelled with 0<i<f,0<j<f. In this section, we use the letters A, B, C, and 
D to denote lattice points. When we use these names together, we generally assume that 
they have coordinates A = {i — 1, j — 1), B = {i — C = — 1), and D = 
respectively, for some i and j. 

The square region with vertices A, P, C, and D will be called the cell at For 
each 7 e Fn, the cells with i e [ord(7i), ord(7^^(^))] will be said to constitute 
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Figure 5: A cell in the pictorial grid 
A B 



C D 



Figure 6: ord(wj) for Example 2.3 
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3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


20 


Wj 


3i 


li 


2i 


32 


3i 


li 


h 


2i 


33 


h 


22 


22 


32 


2,3 


I3 


23 


24 


34 


I3 


25 


oid{wj) 


17 


1 


12 


18 


15 


4 


2 


7 


19 


5 


13 


8 


16 


14 


6 


9 


10 


20 


3 


11 



the 7-stratum. We will refer to this partitioning of the lattice as its stratification. 
The picture of w is obtained from this stratified grid by writing x inside the cells at 

(oTd{wj), j) for 1 < i < /. Wc say that the x at (ord(wj),j) represents the letter wj, 
and define the contents of (ord(wj),j) to be x; (the contents of) any cells not marked 
with an x is said to be empty. 

Example 3.1. In our Example 2.3, the oicd{wj) are as follows: The picture of this w is 
shown in Figure 7. 

On the left edge, the corresponding letters in /^^ are shown. Thicker horizontal grid lines 
separate the strata. On the top are the column numbers of the cells. 

Note the following simple facts, which follow directly from the definitions: 

Remark 3.2. (1) The picture oiw contains exactly one x in each row and in each column 
of cells. 

(2) If two X 's are in the same stratum, then the one on the right is in a row below than 
the one on the left. (We say that the x's occur in increasing order within a stratum.) 

3.2 Shape array for w — local rules 

Now if A — is any lattice point, let w{A) = w{i,j) denote the word in F.^^, obtained 
from the rectangular section of the picture to the left of and above the vertex A, i.e., w{A) 
is the subword of W1W2 ■ ■ - wj consisting of all letters with ordinals < i. Let w{A) = w{i, j) 
denote the word in obtained from w{A) by discarding the subscripts of the letters. By 
the above Remark (2), w{A) equals the standardization of w{A). Let A{A) — A{i,j) 
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Figure 7: The Picture of w for Example 2.3 
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2i 
















X 


























h 
























X 


















^3 
































X 










24 


































X 








25 








































X 


2i 
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denote the shape of the yS'p(2n)-tableau obtained by applying Berele's correspondence to 
w{A). By Lemma 2.7, it is also the final shape obtained by applying the standardized 
Berele correspondence to wlA). 

Example 3.3. Let w as in our previous examples. For A = (7, 8), the relevant region is 



1 2 3 4 5 6 7 



li 
h 
h 
li 
h 
h 
2i 





X 


























X 






























X 




















































X 



so that w{A) = lilil22i, w{A) = 1112. 



Then we have the following: 

Theorem 3.4. (1) Consider any cell, located at and let A = (i — l,j — 1), B = 

{i — C = — 1), and D = be the four vertices surrounding the cell. Then 

the quadruple of shapes {A{A) , A{B) , A{C) , A{D)) falls into exactly one of the following 
cases. Note that, only the case marked as (x) has an x written in the cell. 

{The carry-over group) 

( ) A{A) = A{B) = AiC) = A{D) 

( ) A{A) = A{B) ^ A{C) = A{D) 

( ) A{A) = A{C) ^ A{B) = A{D) 
These three cases are visualized as follows. 



A ^ B 



A ^ B 



A ^ B 



C = D C = D C ^ D 
The rest of the cases will he displayed visually. The parenthesized symbol preceding each 

k 

picture is the name of the case. The symbols D and D are synonymous. 



{The R-S group) 



X 



C 



c 
1 



B 
1 

n 

D 



(M) 



A 

k' 
n 

c 



k 

c 



c 

{k ^ k') 



B 
k' 

n 

D 



(R) 



A 


c 


B 


k 




k+l 


n 




n 


c 


c 


D 




k+1 





{stratum > A; + 1) 
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( Cancellation) 



A 


k 

c 


B 


k 

n 





k 
U 


c 


D 


D 




k 





{stratum < k) 

( The sign Q inside the cell is just for easy recognition; it is not part of the initial data.) 
( The jeu de taquin group) 



A 

(J) u 



C B 

U 



C t D 
A 5 B 



(J') n 



n 



C 5 D 



/A{B)/A{C) \ 
= m or 

[a{a) = a{d)J 

fA{C)/A{B) \ 

= m or 
\a{A)^A{D)) 



A 

(J) u 
c 

A 

(J') n 
c 



c 



c 

i) 



{The reverse R-S group) 



A D B 



k 



B 
U 

D 

B 

h 

D 



/A{B)/A{C) \ 

7^ m or 
\A{A)^A{D)) 

/A{C)/A{B) \ 

7^ m or 
\A{A)^A{D)) 



(W) ^' 



u 



(Ya) 5 



C D D 

k 

{k ^ k') 



C D 
fe-i 

{k > 2) 



fe-i 
U 

D 



(2) r/ie i/iree shapes A{A), A{B), A{C), and the stratum containing the cell ABCD, 
together with the contents of the cell, determines which of the above cases the cell belongs 
to, and the shape A{D). The list in {1), thus read as rules to determine A{D) from the 
information stated immediately above, will be called the local rules. We can recover the 

whole array of A{-) from the picture of w by starting from the empty shapes on the top 
and the leftmost edges and applying these local rules in any possible order. 

(3) The three shapes A{B), A{C), A{D) and the stratum containing the cell ABCD de- 
termines which of the above cases the cell belongs to, and accordingly the contents of the 
cell and the shape A{A). In other words, the local rules are invertible. We can recover 
the whole array of A{-) and the positions of the x 's {i.e. the word w) if the shapes on 
the bottom and the rightmost edges are correctly given, together with the stratification. In 
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other words, the map which takes w to the shapes on the bottom and the rightmost edges 
is injective. 

(4) The sequence of shapes on the bottom edge equals the up- down tableau of degree f 
obtained from w by Berele's algorithm, namely the Berele Q-symbol of w. 

(5) Let 1 < k < n. The sequence of shapes on the rightmost edge in the k-stratum 
represents a horizontal strip growing from left to right. 

(6) The sequence of shapes on the rightmost edge in the k-stratum represents a shrink by 
a horizontal strip from right to left, followed by a growth by another horizontal strip from 
left to right. Moreover, if one puts X^''^ = yl(ord(/ci) — 1, /) and /x*^^^ = A(vk, f), where Vk 
is the row coordinate of the turning point from shrink to growth, then ii^^^X^^^ is also a 
horizontal strip. 

(7) The tableau of shape A{f, f) in which jjP^^X'^^^ is filled by the symbol k and X^^^'^^ jjP^^ 
is filled by the symbol k {k = 1, 2, . . . , n, where A^""*"-*"^ is understood to be A(f, /)) is the 
Sp{2n) -tableau obtained from w by Berele's correspondence, namely the Berele P -symbol 
ofw. 

Remark 3.5. (1) Theorem 3.4 says that the result of Berele's correspondence can be 
completely determined by the "local rules" listed in (1). 

(2) The above set of local rules is an expansion of Fomin's local rules in [Fl] for the 
Robinson-Schensted correspondence. The latter consist of the rules in the carry-over 
group and the R-S group only, in which the stratum condition in (R) does not appear. 

(3) The rules in the jeu de taquin group were used by S. Fomin [F2] and M. van Leeuwen 
[vL], to give a pictorial presentation of Schiitzenbergcr's invohition. 

(4) The local rules thus expanded have certain restricted symmetries, namely a 180" 
rotation and reflection in one diagonal. The restriction derives from dependence on strat- 
ification in distinguishing between cases (R) and (O)- 

(5) The local rules lead to only two possible types of rows in the picture of namely: 



X h 



or 







X 


h 


ri 


h 





u 


u 


u 



The same statement applies to columns of the picture of w. 

(6) The local rules also guarantee that the shapes in the k- and A;-strata (including the 
bottom lines thereof) cannot have more than k parts. This can be shown by induction 
on /c, assuming its validity at the top of the /c-stratum, and proceeding row by row in the 
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k- and A;-strata as follows. Suppose the property is satisfied for the vertices (i — 
< j' < f and i is still in the k- or fc-stratum. It is sufficient to show that there is no 
growth in the (k + l)st or lower row of the Young diagram along the vertical segment 
[i — 1, j') in the picture. By Remark 3.5 (5), we can concentrate on the interval 

starting at the right edge of the cell ( x ) (where the growth always starts in the 1st row) 
and ending at the left edge of the cell (Q) (or the rightmost edge of the picture if this 
row does not have (O))- Looking at the local rules, we know that the growth row number 
is either preserved (rules ( ), (M), (J'), (J') with A{C) / A{B) = UJ), or changes by one 
(increases in (R), decreases in (J') with A{C) / A{B) = Q), as we cross over a cell. Therefore 
the growth row number must turn from k to k + 1 at some stage, if it ever exceeds k. 
However, such change is not allowed in case (R) by the stratum condition. So we cannot 
have growths in rows below the kth, and since we do not have more than k rows on the 
vertices (i — 1, j'), the same holds for the vertices 

3.3 Structure of proof of Theorem 3.4 

The rest of this section is devoted to the proof of Theorem 3.4. 

The proof proceeds by induction based on a natural poset structure defined on the set of 
lattice points [0, /] x [0, /]: if and (i, j) are two lattice points, then < if 

and only Hi' < i and j' < j,m other words, (i', f) lies in the closed rectangle with vertices 
(0, 0), (0, j), {i, 0), and {i.j). We denote by L the poset [0, /] x [0, /] defined in this manner. 
An order ideal of L is a subset I of L for which G / and < (hj) imply 

e /. In the picture / is a set of lattice points in L which is saturated to the above 
and to the left. We say that (i, j) is a cocorner vertex of / if (i, j), (i, i + 1), (i + 1, j) G / 
but {i + 1, j + 1) ^ /. If A is any vertex in L, we denote by P{A) (resp. P{A)) the P- 
symbol obtained by applying standardized Berele's correspondence (resp. original Berele's 
correspondence) to the word w{A) (resp. w{A)). Note that A{A) = sh(P(A)) = sh(P(A)). 

We will show the following Lemma by induction on / e <J{L), the lattice of order ideals 
in L. The lemma is concerned with all P{A), A G / as well as all ^1(^4), A & I. This will 
readily imply Theorem 3.4 (1) by putting I = L. 

Lemma 3.6. Let I be an order ideal in L. 

(1) If A and B are horizontally adjacent vertices in I, with B to the right of A, then we 
have either A{A) = A{B) {called an equal), A{A) C A{B) {a growth), or A{A) i) A{B) 
{a shrink). 

(2) // A and C are vertically adjacent vertices in I, with C below A, then we have either 
A{A) = A{C) {an equal), A{A) c A{C) {a growth), or A{A) D A{C) {a shrink). 
Moreover, the corresponding P-symbols satisfy one of the following relations. 

(2a) IfA{A) = A{C), then we have P{A) = P{C). 

(2b) If A{A) C A{C), and if C has coordinates (ord(7t),j), 7t G i^, then one can obtain 
P{C) from P{A) by filling the new cell A{C) \ A{A) with -ft- 
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(2c) If A{A) i) A{C), and if C has coordinates (ord(7t), j), jt £ A;; then the following 
(2cl)-(2c4) hold: 

(2cl) We have ^ — k for some k e [1, n]. 

(2c2) With k defined as in (2cl); the tableau P{A) does not contain any k, so that k is 
the largest possible letter in P{Al). 

(2c3) If{{r, c)} = A{A)\A{C) , then each of the bottom cells of the 1st through cth columns 
of P{A) contains a k {k's can appear in other columns as welt) . 

(2c4) The tableau P{C) is obtained from P{A) by removing the k in the 1st column {which 
is the "smallest" k), and then shifting each k sitting at the bottoms of the 2nd through cth 
columns to the bottom of its left adjacent column. If we discard the subscripts, P{C) is 
simply obtained from P{A) by removing k at (r, c). 

(3) If A, B , C , and D are the four vertices of a cell contained in I , with D = {i,j), then 
the quadruple {A{A) , A{B) , A{C) , A{D)) falls into exactly one of the cases listed in the 
local rules. 

Remark 3.7. (1) The relation between P{A) and P{C) is not trivial — nothing a priori 
assures any relation between P{A) and P{C), as opposed to P{A) and P{B), which are 
directly connected by standardized Berele insertion. 

(2) The procedure to obtain P{C) from P{A) described in (2c4) can be understood to be 
"column deletion," namely the tableau deletion procedure (as described in [K2, Section 
5.1.5]), modified to serve as the inverse of the column insertion instead of the row insertion. 
It is also a semistandard version of a bijective tool used by Sundaram [Sunl, Proof of 
Lemma 8.7]. 

Proof. We prove Lemma 3.6 by induction using Lemma 3.8 and Lemma 3.9. 

Lemma 3.8. Define an order ideal Iq of L by Iq — { (0, j) \ j e [0, /] } U { (i, 0) | i e 
[0, /] }. Then Lemma 3.6 holds for I — Iq. 

This is clear since, by definition, the word w{A) is the empty word for any A G /q, so 
that A{A) and P{A) are all empty. The essential point of the proof hes in the following 
inductive step. 

Lemma 3.9. (the key technical lemma) Let Ii be an order ideal of L which contains 
vertices {i — l,j — 1), {i — 1, j), and {i,j — 1), but not {%,])■ Note that I2 = hU 
is also an order ideal of L. Then if Lemma 3.6 holds for Ii, then it also holds for 12- 

With this admitted. Lemma 3.6 is proved in the following manner. If 7 7^ L, then I 
necessarily has at least one cocorner. Therefore, starting with Iq, we can continue to 
enlarge the region of validity of Lemma 3.6 by applying Lemma 3.9 until we reach the 
case I — L. □ 
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3.4 Proof of Lemma 3.9 (the key technical lemma) 

Let A = {i - l,j - 1), B = {i - C = - 1), and D = Also let i = ord(7t) 

where 7 G and 7^ G The symbols A, B, C, D, 7 and 7^ will be used 
throughout the proof in this sense. 

Since the claims already hold for segments and cells contained in Ii, the new claims to be 
proved are the claims (1) for the segment CD, (2) for the segment BD, and (3) for the 
cell ABCD. Looking at the local rules in Theorem 3.4, one can see that (1) for CD and 
the initial part of (2) for BD will follow from (3) for ABCD. So we will concentrate on 
the validity of (3) for ABCD, and the latter part of (2) for BD, i.e., the relation between 
P{B) and P{D). 

First we show that the three shapes A{A), A{B), and A{C), the stratum containing 
ABCD, and the contents of ABCD matches exactly one of the cases listed in Theorem 3.4 
(1). Since the cases are disjoint with respect to these data, what we have to show is that 
they cover all possibilities. Since (1) holds for AB and (2) holds for AC , we know that 
A{A) and A{B) (resp. A{A) and /1(C)) are either equal or one covers the other. Looking 
again at the list, we find that what we need to show is the validity of the following two 
statements: 

(a) ABCD can contain an x only if A{A) = A{B) = A{C). 

(b) If A{A) D A{B) = A{C), then A; > 1. 

To see (a), first recall that an x can appear only once in each row and each column of 
our picture of w. Therefore if the cell (i.j) of the picture of w contains x, the cells {i, 1) 
through — 1) must be empty, so that w{A) = w{C) and A{A) = A{C). Similarly the 
cells (1, j) through {i — must also be empty, so that w{A) — w{B) and A{A) = A{B). 

To show (b) we first prove some easy facts, which will also prove useful in later arguments. 

Lemma 3.10. In order that the standardized Berele insertion of the letter j3s into P 
involves cancellation of a k-k pair, P must contain at least one k. 

Proof of Lemma 3.10. This is clear since the cancellation of k-k is first caused by a k, 
bumped by a /c from the /cth row into the {k + l)st row. □ 

Lemma 3.11. Let A, B, C, D he as in Figure 5. 

Assume that A{Al) ^ A{B) and A{A) ^ A{C). Then we have an x representing straight 
to the left of ABCD. Also there must he an x straight ahove ABCD. Let j3s he the letter 
represented hy the latter x. Then (3 must he strictly smaller than 7 in Pn- 

Proof of Lemma 3.11. Since Ps < It: P ^ 1 clear. The x's in the same stratum must 
occur in increasing order, so the possibility of /3 = 7 is rejected. 

□ 
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Lemma 3.12. In the notation and situation of Lemma 3.11, assume that A{A) i) A[B) 
and A{A) i) A{C). Putting X = A{A) \ A{B) = {(r,c)} and Y = A{A) \ A{C), further 
assume that either X = Y or X lies in a lower row than Y in A{A). Then the sliding 
path occurring in the standardized Berele insertion P{A) ^ j3s must involve the square 

B 

(r — l,c) of the Young diagram. {This requires that the square (r — l,c) exists, so that 
r > 2.) 

Proof of Lemma 3.12. Since P{A) contains no k (by (2c2) applied to AC), the cancel- 
lation involved in P{A) j3s must be for a pair smaller than k-k due to Lemma 3.10. 

8 

Accordingly, the largest possible letter that gets moved (or removed) in the bumping phase 
is A; — 1 (recall that the bumped letter moves a letter larger than itself). Therefore, the 
/c's in P{A) do not move in the bumping phase, nor is any cancelled. This assures that, 
when sliding starts, the bottoms of the 1st through cth columns are still occupied by fc's, 
as was the case before the bumping starts, by (2c3) applied to AC and our assumption 
on the positions of X and Y . Now in the sliding phase, each of these /c's either stays put, 
moves left, or moves up. When the sliding is finished, the tableau must be semistandard; 
in particular no two /c's can share a single column. This is only possible if each of the fc's 
in the first c columns sticks to its column. Therefore the k at (r, c), which was the end of 
the sliding path, must have moved up into the cell (r — 1, c). □ 

Returning to the proof of Lemma 3.9, we find that (b) follows from the above lemma, 
finishing the proof of the coverage of all possible cases. 

It remains to show that the shape A{D) agrees with that given by the local rules, and 
that the relation between P{B) and P{D) is as stated in (2). We will do these together 
case by case. First we deal with some easy cases, which are marked by ( ) in the list. 

The ceirry-over group. First assume A{A) — A[C). The cells straight to the left of 
ABCD do not contain an x and, by assumption, the cell ABCD is also empty in this case. 
Therefore we have w{B) = w{D), so that P{B) = P{D) and A{B) = A{D), validating 
the prescription by the local rule. Also, P{B) — P{D) validates Lemma 3.6 (2a) for BD. 

Next assume A{A) ^ A{C) and A{A) = A{B). By a similar argument we have w{C) = 
w{D), P{C) = P(L'), and A{C) = A{D). This vahdates the prescription for A{D). Also, 
the relation between P{B) and P{D) ((2b) or (2c) for BD) is validated because the same 
pair of tableaux occur on AC, which is contained in Ii. 

The R-S group. The case (x). We have w{A) = w{B) = w{C), which implies 
P{A) = P{B) = P{C). Since P{D) = P{C) ^ -ft, it also equals P{B) ^ 7*. Note that 

'-ft is larger than any letter in w{B). This means that P{D) is obtained from P{B) by 

adding 7^ at the end of the 1st row. Therefore we have A[B) = A{C) C A[D), and (2b) 
holds for BD. 

More Notation. In the remaining cases, we have A{A) ^ A{B) and A{A) ^ A{C). 
Therefore we have an x straight to the left of ABCD representing the letter 7^. Also we 
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have an x straight above ABCD. Let f3s be the letter represented by this x. In the 
rest of the proof, (3 and /3g will always be used in this sense. 

The case (M). We have an x straight to the left of ABCD. By (2b) apphed to AC 

(which is in Ji), the difference between P{C) and P{A) is that P{C) has an extra 7* at 

position A{C) \ A{A), and 7^ is the largest letter appearing in P{C). By definition wc 

have P{B) = P{A) <— (3s and P{D) = P{C) f5s- Moreover, the assumption of the case 
B ^ B 

A[A) C A[B) assures that the operation P{A) j3s is an ordinary insertion. 

B 

We want to know how P{C) ^ (3s differs from P{A) ^ (3s. Since the position A{C)\A{A) 

B B 

is a cocorner of A{A)., it can be a part of the bumping path for the insertion P{A) ^ (3s 

B 

only as its final point where a new cell is added. However, since A{B) 7^ A{C), this 
bumping path ends at some other cocorner of A{A). If this cocorner is in a row above 
A{C) \ A{A), then the bumping path remains the same for the insertion P{C) <— (3s. If 

B 

this cocorner is in a row below, the bumping path also remains the same for P{C) ^ (3s 

B 

since, when it passes the row of A{C) \ A{A), it can already bump an clement of P{A) 
and the extra 7^ remains intact since it is definitely greater than that element. In either 
case the insertion of Ps into P{B) causes exactly the same change as it would cause to 
P{A), leaving 7^ where it is. This vahdates the local rule for A{D) and (2b). 

The case (R). The relation between P{A) and P(C), P{A) and P{B), P{C) and P{D) 
are the same as in the previous case. This time we are under the assumption that A{B) — 
A[C), so the bumping path of inserting (3s into P{C) hits A{C) \A{A), and tries to bump 
the extra jt, say in the kth row, to row A; + 1. Under the stratum condition attached to 
(R), 7t can sit in row k + 1 without violating the symplectic condition, so -P(C) ^ Ps 

B 

ends in an ordinary insertion, the result being P{B) plus an extra 7^ at the end of row 
k + 1. This validates the local rule for A{D) and (2b). 

The cancellation group. The case (O)- We proceed as in the previous case. This 
time placing 7^ in row k + 1 would violate the symplectic condition. 7 cannot be less than 
k since jt is allowed to sit in the kth row in -P(C), so 7 is either k or k. On the other hand, 
let 7^, denote the letter which bumped 7^. This letter is also allowed to sit in the kth row 
in P{B), and since it bumps 7t we must have 7' < 7. The only possible combination is 
y = k and 7 = A;. Then, as explained in the third paragraph of Subsection 2.7 (p. 10), 
the cells to the left of A{C) \ A{A) in this row all contain /c's. Moreover, by the proof of 
Lemma 2.7, kt is the smallest k, and the smallest A; in P(C) has the same subscript t. The 
instruction is to remove kt and shift the remaining /c's in this row to the left as part of the 
sliding. Then sliding stops here since A{C) \ A{A) is a corner of A{C). The tableau P{D) 
thus obtained matches the description of (2c4) relative to P{B). We have A{D) = A{A), 
validating the local rule for the shape. See Figure 8 Here ^ signifies the bumping path 
that occurs in the first k — 1 rows of P{B) and P{D), that distinguish them from P{A) 
and P{C) (respectively). The two bump paths are identical in this shown above. 
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Figure 8: The cancellation case 
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Now (2c 1) is already validated since ^ — k. is not only the smallest k, but the only 
k in P{C) since it is the largest letter in 'w{C). Then (2b) apphed to AC implies that 
P{A) does not contain k. In addition, the letter f3s inserted into P{A) (to produce P{B)) 
cannot be a k due to Lemma 3.11. Therefore P{B) does not contain A;, which validates 
(2c2) for ED. The argument in the previous paragraph validates (2c3) and (2c4) for BD. 

The jeu de taquin group. The case (J'). Since AC is a growth, by (2b) P{C) is 
P{A) plus an extra 7j at some cocorner of A[A). Put Y = A{C) \ A[A). Since AB is 
a shrink, the Berele insertion of (3s into P{A) involves sliding, ending at some corner of 
A{A). Put X = A{A) \ A{B) = {(r, c)}. Since we are in case (J'), where A{C) \ A{B) is 
a domino, Y is either immediately to the right of or below X. 

If one starts with P{C) instead of P{A) and Berele inserts the letter /5s, then bumping, 
cancellation, and sliding proceeds without any alteration until the hole arrives at X. Note 
that since X is a corner of A{A), only one of (r + 1, c) or (r, c + 1) can be a part of A{C). 
One of them is Y, and the other is not in A{C)] hence, the entry at Y, namely 7j, slides 
into the hole at X. Therefore, P{D) has the same shape as P{A), and is obtained from 
P{B) by adding 7^ at X. This vahdates the local rule for A{D) as well as (2b) for BD. 

The case (J'). Let X, Y be as in the previous case. This time A{C) \ A{B) is not a 
domino, so X is not adjacent to Y. 

We consider how the operation -P(C) Ps differs from P{A) /3s. In the bumping 

phase, the existence or nonexistence of 7* at Y does not affect anything for the same 
reason as in case (M) (even if X is in a row below than Y). In the sliding phase, if the 
sliding path for P{A) does not pass through the cells adjacent to Y, then clearly the 
existence or nonexistence of 7^ at X has no affect. If the sliding path passes through 
some cell Z adjacent to Y, then that cell cannot coincide with the end point X of the 
sliding, under the current assumption. Then in the next step, the letter that slides into 
Z in P{A) ^ Ps also shdes there in -P(C) Ps regardless of the existence of 7^ (and 7^ 

B B 

does not move), since that letter is smaller than 7^. The rest of the shding is not affected 
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either. Therefore A{D) = A{A) UY\X, and P{D) is obtained from P(B) by adding 7^ 
at Y. This vahdates the local rule for A{D) and (2b) for BD. 

Still More Notation. In the remaining cases, AC is always a shrink. Put Y = A{A) \ 
A{C), and Y = {(r, c)}. By (2c) applied to AC, we have 7 = A; for some k, P{A) contains 
some ku (with some index u) at Y, and P{C) is obtained from P{A) by removing the 
smallest k and shifting the fc's to the left inside the horizontal strip for k up to Y, vacating 
the position Y. In the rest of the proof, Y, r, c, k and ku will always be used 
in this sense. 

Remcirk 3.13. In the remaining cases, the following points easily follow regardless of 
further case distinction. 

(a) -P(-B) does not contain any k. This is because P{A) does not contain any k due to 
(2c2) apphed to AC, and the inserted letter Ps cannot be a ^ due to Lemma 3.11. In 
particular, if BD is shown to be a shrink, then (2c2) for BD follows. 

(b) If BD is shown to be a shrink, then (2cl) for BD follows from that of AC since the 
segments AC and BD are in the same row. 

With these at hand, we continue our case-by-case analysis. 

The case (J). Put X = A{B) \ A{A). Since AB is a growth, the Berele insertion of Ps 
into P{A) ends in an ordinary insertion at X. Since we are in case (J), where A{B)\A{C) 
is assumed to be a domino, X is either immediately to the right of or below Y. 

First assume that X is to the right of Y. See Figure 9 Note that the occupant of X 
in P{B) is also a k, say ky, since it has to be greater than the occupant of Y, which 
is out of the bumping path and hence still contains ku, and it cannot he a. k because 
of Remark 3.13 (a). Also note that k^ is the letter bumped from the previous row (or 
the inserted letter if r = 1). If one inserts f3s into P{C) instead of P{A), the bumping 
proceeds up to the row of Y, where ky now lands at Y instead of X. Therefore the shape 
of P{D) equals that of P{A), validating the local rule for A(D). Since BD is a shrink, 
(2cl) and (2c2) follow by Remark 3.13. Then (2c3) follows since the /c's in the 1st through 
cth columns do not move in the operation P{A) and P{B) has a /c at X as well. 

B 

Comparing P{D) with P{B), the /c's in the 1st through cth columns shifted to the left, 
since they are not affected by insertion of (5s, and k^ at X in P{B) also shifts to Y in 
P{D). This shows (2c4) for BD. 

Next assume that X is below Y . This can only happen if the bumping procedure in 
inserting j3s to P{A) bumps k^ at Y (row r) into row r + 1, which happens to have been 
shorter than row r by one cell. If one inserts j3s into P{C) instead of P{A), the letter 
which would bump ku at Y for P{A) just stays at Y , forming the end point of the bumping 
path. Therefore the shape of P{D) is the same as that of P{A), validating the local rule 
for A{D). Since BD is a shrink, (2cl) and (2c2) follow by Remark 3.13. Then (2c3) for 
BD follows from that for AC since the shrinking cells of AC (Y) and BD (X) are both 
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Figure 9: The case (J), horizontal domino 
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Figure 10: The case (J), vertical domino 
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in the same column (column c), and the columns to the left of this are intact. Finally 
(2c4) follows from that of AC for the same reason. 

The case (J). Let X be as in the previous case. X is the end point of the bumping path 
involved in the operation P{A) <— Ps, and Y is the end point of the shift of /c's observed 

in comparison of P{A) and P{C). If X is in a row above y, then it is clear that the shift 
of A';'s does not affect the bumping procedure for inserting j3s- If X is in a row below F, 
then the bumping path intersects with the shifting path at only one cell. This cell must 
contain the leftmost occurrence of k in that row by definition of the bumping procedure. 
All columns to the left are longer (since each one by assumption has a whose position is 
lower because the /c's form a horizontal strip), and all their contents are < k (involving fc's 
with smaller indices only). This forces the bumped k to sit in the empty cell immediately 
below the intersection, marking the end of the bumping path. 

Now the intersection cannot occur at Y , since if it did, then X must have been its lower 
adjacent, which would put us in case (J) rather than (J). Now if Ps is inserted to P{C), 
the bumping procedure is the same until it comes to the intersection. At the intersection 
a different k is bumped, and it sits straight below at X. Therefore A{D) — A{C) U X, as 
prescribed in the local rule, and BD is a shrink, so the latter half of (2) for BD consists 
of (2cl)-(2c4). Now (2cl) and (2c2) follow from Remark 4.1; further (2c3) follows since 
P{A) has the same property and the difference in P{C) concerning these fc's is just one 
vertical movement of one of the fc's. Finally, (2c4) also follows from the above description. 

The reverse R-S group. The case (W). The bumping path involved in the insertion 
of Ps into P{A) does not intersect the shifting path, since if it did, the insertion would end 
in an ordinary insertion after bumping one of the /c's in the shifting path (as explained 
in case (J)), contradicting the assumption that A{A) i) A{B). So if one inserts (3s into 
P{C) instead of P{A), the bumping phase is exactly the same. The assumption of the 
case (W) is that the end point of the sliding path involved in P{A) <— (3s, which we again 

B 

call X, does not coincide with Y. 

First assume that X is higher than Y in A{A). In this case the whole sliding path is 
higher than the shifting path, and there is no intersection. We claim that the insertion 
of (3s into P{C) causes the same sliding as that into P{A). Look at each step of the 
sliding. If the hole is at least two rows above the shifting path, clearly the shding occurs 
in the same direction regardless of the shift. Assume that the hole is immediately above 
the shifting path. Because of their positions, the sliding path must be purely horizontal 
after this point to the end of the row, and if the shifting path has more squares to the 
right of the column of the hole, then that portion of the shifing path also must be purely 
horizontal. We distinguish two cases: (1) If the shifting path continues more to the right, 
then the right adjacent of the hole contains a letter strictly smaller than k. If one shifts 
the /c's in the shifting path (to make it into P{C)), the cell below the hole still contains 
some k, so the sliding in P{C) proceeds to the right, as desired. (2) If the shifting path 
ends exactly at the cell below the hole, then in P{C) that place is vacant. There is no 
comparison involved in this case, and the sliding again proceeds to the right as desired. 
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Figure 11: The case (J) 
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In these cases, the remaining claims are easy, so we omit the details. 

On the other hand, if X is lower, then by Lemma 3.12 the sliding path reaches X from 
above, and X is the only intersection of these two paths. Let ky denote the contents of 
X in P{A). Since Y is higher than X, we must have at least k^+i in the shifting path, 
which must be in the column immediately to the right of X. Now we again claim that 
the insertion of (3s into P{C) causes the same sliding as it causes to -P(^), except that 
the contents of the end point is a different k. Look at each step of the shding. So long 
as none of the candidates to slide into the hole belongs to the shifting path, the sliding 
is not affected by the shift. Suppose the hole is the left adjacent of The hole is 

straight above X, so in P{A) ^ j3s the sliding proceeded below. After the shift, the 

B 

lower adjacent of the hole is either k^^i (when the lower adjacent is X) or strictly smaller 
than k (when the hole is at least two rows above X). The right adjacent of the hole is 
either /c^_)_2 (when Y is at least two cells apart from the hole) or vacant (when the right 
adjacent is Y). In either case, the shding proceeds below in -P(C) <— Ps- Finally assume 

B 

that the hole is immediately above X (just before sliding ends). The case where the right 
adjacent of the hole is k was discussed just above, and otherwise the right adjacent is 
vacant so that the sliding must land into X regardless of whether it is for P{A) or P{C). 
In summary, the location of the sliding path for P{C) <— (3s is exactly the same as that 

B 

for P{A) <— (3 Si whose end point contains /c^+i instead of A;^. The tableau thus obtained 

B 

is the same tableau as one obtains from P{B) — P{A) (3s by the procedure described 

B 

in (2c4). Now the remaining claims follow easily. 

The case (Ya). Again by Lemma 3.12, the bumping path and the sliding path do not 
intersect the shifting path before reaching the cell X — Y,so up to that point insertion of 
(3s to -P(C) proceeds in the same manner as that to P{A). Now the shding for P{A) (3s 

B 

involves the cell (r — 1, c). If (r — 1, c+ 1) is empty, then the sliding m. P{C) ^ (is ends at 

B 

(r — l,c), and the difference between P{D) and P{B) is, as expected, the shifting of /c's 
at the bottoms of 1st through cth columns. If (r — 1, c + 1) is not empty (see Figure 12 
below, where \ signifies that the difference with the left tableau is a sequence of sliding, 
and a bumping preceding it, which is not mentioned in the picture), then this cell as well 
as all cells in this row to the right must contain something > A;, because the sliding in 
P{A) ^ (3s proceeded to X = Y which contained A;„. Since no letters > k can appear 

B 

in P{A), they are all /c's, and remain the same in P{C), and in P{C) <— (3s the sliding 

B 

proceeds towards the end of row r — 1. In this case the difference of P{D) from P{B) 
spreads to the end of row r — 1, where the difference is also the shifting of /c's at the 
bottom cells. Thus all claims now follow for this case. 

(End of Proof of Lemma 3.9) 
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Figure 12: The case (Ya) 
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3.5 Concluding the proof of Theorem 3.4 



Putting / = L in Lemma 3.6, wc have actually already shown (1). (2) is also contained 
in the first part of the proof of Lemma 3.6. Note that the irrelevance of the order of 
application is automatic since we have proved that A{D) is always equal to the shape 
of the P-symbol of w{D), which is determined independently of the local rules. To see 
(3), we just have to look again at the local rules to check that the cases are disjoint with 
respect to the shapes A{B), A{C), A{D) and the stratum, which is easy. Note that we 
did not claim that we can start from any sequences of shapes along the rightmost edge 
and the bottom edge; what we show here is that if an array of shapes is obtained from 
a w, then it can be recovered from the rightmost and bottom edges. No statement as to 
"coverage of all cases" in (3) is necessary for showing this type of "injectivity" result. (4) 
is actually just the definition of the shapes A{f,j'), < j' < f. To show (5), suppose the 
bottom row of the fc-stratum occurs in row Uk- By Lemma 2.7, in P{uk, /), the letters ki, 
k2, ■ ■ ■ , km^(k) appear from the left to the right forming a horizontal strip. By Lemma 3.6 
(2cl), shrinks do not occur in the /c-stratum, and by Lemma 3.6 (2b) the difference of 
the growth from {i' ~ 1, /) to {i', f) (where i' is in the /c-stratum) is the position of the 
corresponding subscripted k in P{i,f ). Hence (5) follows. Next, if A, B, C are three 
vertically contiguous vertices on the rightmost side of a A;-stratum, it cannot happen that 
AB is a growth and BC is a shrink since, by Lemma 3.6 (2b), P{B) contains a k and this 
would violate Lemma 3.6 (2c2). Therefore the rightmost side of a ^-stratum consists of a 
series of shrinks first, followed by a series of growths. By Lemma 3.6 (2c4), these shrinks 
are a part of the horizontal strip gained in the /c-stratum. Also by Lemma 3.6 (2c3), these 
shrinks must happen from right to left. Hence the initial part of (6) follows. The last 
part of (6) also follows. The part concerning the growth part in the ^-stratum follows by 
the same argument as that for (5). Finally (7) follows by combining (5) and (6). □ 



4 The Reverse Correspondence 

As stated in (3) of Theorem 3.4, if we know the up-down tableau on the bottom and the 
sequence of shapes on the rightmost edge, both properly produced from a word we 
can recover the whole array of shapes as well as the word w. On the other hand, suppose 
we are given a pair (P, Q) of an S'p(2n)-tableau P and an up-down tableau Q produced 
from a word w by Bcrelc's correspondence, and we wish to recover w from P and Q in 
a pictorial manner. We can put Q along the bottom edge; however, the tableau P only 
tells us the shapes on the rightmost edge at certain points: at the border between the 
{k — 1)- and /c-strata for each k, and at some point in the fc-stratum where the sequence 
of shrinks turns into a sequence of growths for each k. This of itself is insufficient to 
determine the rightmost edge, since we do not know directly from P and Q how many 
k-k cancellations occur in the A;-stratum, nor what shape should be put at the border 
between k and k. Nonetheless, Berele's correspondence in its original form is reversible, 
so it should be possible to see how to do this from our pictorial point of view. 
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Suppose we are given a pair (P, Q) as above, which by the usual Berele correspondence 
corresponds to a word w. If we apply our algorithm to this word, we obtain Q along the 
bottom edge, and along the right edge an up-down tableau T = (r*^°\ r^-^\ . . . , r^^^) which, 
together with the stratification datum, determines P in the manner described in (6) and 
(7) of Theorem 3.4. If we use the notation in the previous section for this w, then r^^^ = 
A{i, /). In fact, not merely a sequence of shapes, but a sequence of symplectic tableaux 
(P(0, /), P(l, /),..., P{f, /)) is attached to this edge; we put P^^ = P{i, f) for simplicity. 
P^^^ is the symplectic tableau determined by the up-down tableau (r*^°\r*^^\ . . . ,r(*)) in 
the same manner. 

Wc claim that we can recover 

p{/-i) from P and Q as in the following Theorem 4.2, so 
that inductively we can recover the whole array of shapes without going back to w in the 
first place. 

Remark 4.1. (5) and (6) of Theorem 3.4, together with (2c2) of Lemma 3.6 imply that, 
if one knows which stratum the bottom row cells of the picture belong to, then P'^f~'^^ is 
completely determined from P as follows: 

1. If the bottom row belongs to fc-stratum, with A; G N, then P contains a letter k, 
and P^f^^^ is obtained from P by removing the rightmost occurrence of the letter 
k. (The rightmost segment is a growth.) 

2. If the bottom row belongs to fc-stratum, with A; G N, and if P contains the letter k, 
then P^f~^^ is obtained from P by removing the rightmost occurrence of the letter 
k. (The rightmost segment is a growth.) 

3. If the bottom row belongs to A;-stratum, with /c G N, and if P does not contain the 
letter A;, then p(-^~^) is obtained from P by adding a letter k to the bottom of the 
first column of P which does not already contain k. (The rightmost segment is a 
shrink.) 

Theorem 4.2. Let P, Q be as above, and put Q = {k^^\ . . . , k,^-^^). Put I ~ 
max{ 1{k^^^) I < j < / }, and let ^ — m or fh {m E N) be the largest letter in P. 

1. Ifm > I, then 7 is the largest letter in w, so that the bottom row of cells in the picture 
belongs to the '^-stratum, and P^^~^^ is obtained from P by deleting the rightmost 
occurrence ofj. 

In the remaining cases, assume that m <l. 

(2) If P contains a letter I, then it is also the largest letter in w, so that the bottom row 
of the picture belongs to the l-stratum, and p(-^~^) is obtained from P by deleting 
the rightmost occurrence of I. 
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(3) If P does not contain the letter I, and if there is no l-shrink in Q {i.e. k^~^^ D k^^ 
never occurs), then I is the largest letter in w {also in P), so that the bottom row of 
the picture belongs to the l-stratum, and P^f~^^ is obtained from P by deleting the 
rightmost occurrence of I. 

Now suppose that P does not contain the letter I, and that there is an l-shrink in Q. Let 
P be the tableau obtained from P by adding an I to the bottom of the first column of P 
which does not already contain I. Put Q on the bottom edge of a 1 x f grid, and put the 
shape of P at the rightmost vertex of the upper level. Work backwards by local rules from 
right to left so long as the vertical segment remains a shrink, assuming that we are in the 
l-stratum. 

(4) If we reach the leftmost edge in this test, then p(^^^) cannot be equal to P. In this 
case I is the largest letter in w {also in P), so that the bottom row of the picture 
must belong to the l-stratum, and P^f~^^ is obtained from P by deleting the rightmost 
occurrence of I. 

(5) If we encounter the case (Q) before reaching the leftmost edge, then we have P^f~^^ — 
P. In this case the largest letter in w is I, so that the bottom row of the picture 
belongs to the l-stratum. 

Remark 4.3. In distingushing the cases (4) and (5), what we propose to do in the above 
statement is to hypothetically assume that the segment (/—I, /)-(/, /) is a shrink, and try 
to go backwards on the picture by one row to see if this assumption yields an unacceptable 
row. 

The situation in (4) is clearly a case of making the wrong assumption, since the leftmost 
edge can never be a shrink in a correct picture. 

The case (5) is more delicate. If we encounter Q (5) and consequently reach a 

growth on the vertical segment, actually we can continue to apply local rules backwards 
to produce exactly one x to the left of Q and reach the leftmost edge with empty shapes 
on both ends of the vertical segment. For let R^^\ r'^^\ . . . , R'^f^ be the shapes obtained 
on the upper level. All the local rules we use with a growth on the right edge will yield a 
growth again on the left edge, with the exception of (x), which sets an equal left edge. If 
we reach the latter case, the reverse computation of the row is complete, since the local 
rules ( ) insist that all vertical segments further to the left are equals; since k,^*^^ is empty, 
K^°^ is also empty. Now, if the right edge of the leftmost cell is still a growth, then since 
K^^^ ~ (1), we must have k^^^ = 0. Since k^^^^ is also 0, the leftmost cell falls into the case 
(x). This means that we always will obtain exactly one cell in case (x), and the shapes 
^(0)^ ^(1)^ ^ j^{f) form an acceptable row. 

The above reasoning also shows that if we hypothesize a growth along the segment (/ — 
1, /)-(/, /) that we will always get an apparently acceptable row of the diagram — whether 
or not it is actually correct. Thus, it is crucial when in doubt to hypothesize a shrink 
along the right edge unless it yields an unacceptable row. 
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Consider the following example, where it only becomes apparent we made the wrong 
choice after two rows have been created working backwards. Let -P = 2 2 > ^^^^ Q 
in the bottom of the following partial picture (in which / = 8). These numbers indicate 
the parts of partitions, not tableaux. If one assumes that A{7, 8) = (2, 1) and P^'^^ = 2 ^ 
so that the segment (7, 8)-(8, 8) is a growth, one obtains the shapes on the 7th row as 
below. To go up one more level, one is forced to take A{6, 8) = (2) and P(^) =11, smee 
by (6) of Theorem 3.4 a growth cannot follow a shrink within the 2-stratum. This gives 
the shapes on the 6th row as indicated. However, this is impossible, because the next row 
of cells above must belong to 1- or 1-stratum, whereas one of the shapes has more than 
one part: 



row 6 —■ 
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21 


31 
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row 7 — : 
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row 8 —■ 
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31 


32 


33 


32 


22 



The correct picture corresponding to this pair of tableaux is shown after the proof of 
Theorem 4.2 is complete. 

Proof. First note that saying that 7 is the largest letter in w is the same thing as saying 
that the bottom row of the picture of w belongs to the 7-stratum. 

We make a couple of easy points. 

Lemma 4.4. // the largest letter in w survives in P, then P^f~^^ is obtained from P by 
deleting the rightmost occurrence of ^. 

Proof. This follows immediately from Remark 4.1. □ 
Lemma 4.5. w contains at least one letter > I. 



Proof. By the definition of symplectic tableau, we see that P{f,j) (where j is such that 
1{k'^^^) = I) contains some letter > I. Since P{f,j) contains a subset of the letters in w, 
the claim follows. □ 

Lemma 4.6. Any letter m' or m' with m' > I which appears in w also appears in P. 
Proof, m' or m' could only have been canceled after being pushed into the m'th row. □ 
Now we come back to the case-by-case analysis of Theorem 4.2. 

(1) Since m > /, combining Lemmas 4.5 and 4.6, we conclude that the largest letter in w 
is 7. The rest follows from Lemma 4.4. 

Note that in all remaining cases, no letters > I can appear in w by Lemma 4.6, so that 
the largest letter in w is either / or I. 
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(2) In this case P contains Z, so it is the largest letter in w. The rest follows by Lemma 4.4. 

(3) If P did not contain I, then the largest letter in P would be less than I, so that 
l{K^f^) < I. However, this would necessitate an Z-shrink on the part of contradicting 
our assumption. Therefore P contains /. If tf contained /, then there must have been 
an /-/ cancellation, which would again cause an Z-shrink, contradicting our assumption. 
Therefore / is also the largest letter in w. The rest follows by Lemma 4.4. 

(4) This hypothetical row in the picture is clearly impossible since the leftmost edge must 
be identically zero (empty). By Remark 4.1 this eliminates the possibility of the largest 
letter in w being [, so that the largest letter must be I. The rest follows by Lemma 4.4. 

(5) By an argument presented in Remark 4.3, continuing backwards by local rules in this 
hypothetical row of cells produces exactly one x to the left of the circle, and reaches the 
leftmost edge with empty shapes on both sides of the vertical edge. Let . . . , 
K^^"* be the shapes obtained on the upper level. They determine an up-down tableau Q if 
we identify the unique pair of consecutive identical shapes k!^'^^^'' = R^^^ just above the cell 
labeled with x . Let v be the word corresponding to the pair (P, Q) by Berele's correspon- 
dence. Our pictorial procedure applied to v yields a vahd (/ — 1) x (/ — 1) diagram. We 
can then paste these shapes onto the (/ — 1) x / diagram by simply duplicating column 
j — 1. All we need to show is that this (/ — 1) x / diagram and our hypothetical row fit 
together properly to form a valid / x / diagram. Since all cells follow local rules, what 
this actually means is that there is no inversion of strata between the picture of v and 
the hypothetical row, and that if the bottom row of v and the hypothetical row belongs 
to the same stratum, then the positions of x in those two rows are in increasing order. If 
these conditions are satisfied, we can define w by putting / between the (j — l)st and the 
jth letters of v. Then the synthesized f x f picture coincides with the picture of w, and 
the claim will be proved. 

First we show the consistency of stratification. Since the hypothetical row is produced 
by the local rules for the Z-stratum, it is sufficient to see that the word v contains no 
letters > I. Now inductively assume that the whole theorem is true for any pair (P**, Q'') 
whose Q-part has order / — 1. (The starting point of induction is the trivial case where 
/ = 0.) Note that the local rules for the /-stratum, with shapes of length < / on the lower 
edge, assure that the shapes on the upper edge also have length < /. Therefore we have 
max{ /(k^-^^) I < j < / } < Z. Also the largest letter in P is Z by construction. Then 
the theorem apphed to the pair (P, Q) assures that the largest letter mv<l. Hence the 
consistency of stratification is proved. 

Next suppose that row / — 1 of the picture of v belongs to the /-stratum. Again by the 
theorem applied to (P, Q), this implies that (/ — 2, / — !)-(/ — 1, / — 1) of the picture of 
V is a shrink (which is shifted to (/ — 2, f )-{f — 1, /) in the synthesized picture), so that 
row / — 1 of the picture of v (as well as the synthesized picture) contains exactly one x 
and O- We want to show that the position of x in row / of the synthesized picture is to 
the right of that in row / — 1. 

To analyze the relation between two consecutive rows in the picture, we will use the 
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Figure 13: Two vertically contiguous cells 
V 




following two lemmas. Consider two vertically contiguous cells, and suppose that the 
shapes A, v and A' are given. (See Figure 13.) 

r s 

Lemma 4.7. Suppose we are given a sequence of consecutive shrinks u D jj, D X with 
r < s and suppose A D A' or A C A'. Working backwards by local rules, suppose that we 

r' 

do not encounter the case x or Q- Then we obtain i/' D /x' D A' with r' < s' . 

t t 

Proof. We take several cases. First suppose that A D A. II t ^ s then n' D n and s' = s. 
Now if also t ^ r, then r' — r and the lemma follows. Otherwise, t — r means that 
r = t7^s, so r<s implying that r' < r + 1 < s. (Note that no applicable local rule 
allows the row of shrink to increase by more than one.) Finally, iit — s then s' — s + 1, 
so in any case r' < r + 1 < s + 1 = s'. 

Now suppose that A'cA. Uty^s — 1 or t — s — 1 but ///A' is not a vertical domino, 
t 

then s' = s and /i' C /i. Now if also t^r — 1 or t = r — 1 but u/fj,' is not a vertical 
domino, then r' = r and the lemma follows. Otherwise, if t = s — 1 and u/fi' is a vertical 
domino, then r' = r — 1 implying r' < r < s = s'. Finally, if t = s — 1 and /i/A' is a 
vertical domino, then s' = s — 1. But here the sth and s — 1st parts of /i must be equal, 
so a priori r < s — 1. We also get /i' C /x, so r' — r. Thus, r' < s — 1 = s'. So the lemma 
holds in all cases. 

□ 

The following lemma is similarly proven by taking cases. 

r s 

Lemma 4.8. Suppose we are given a sequence of consecutive growths v d ^ <Z \ with 
r > s and suppose A D A' or A C A'. Working backwards by local rules, suppose that we 

do not encounter the case x. Then we obtain v' (Z /i' C. v' with r' > s'. 

Returning to the proof of Theorem 4.2, first we show that the circles occur in increasing 
order in the rows / — 1 and / by using Lemma 4.7. Since Q cannot occupy the same 
column in both rows (this would place a growth and a shrink at the same time on the edge 
in between), it is enough to see that Q cannot appear earlier (from the right, since we are 
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working backwards) in row / — 1. Let R'^^^ denote the shape at (/ — 2, j) in the synthesized 

picture, for any j. Under the current assumption, if we set R^^^ D R^^^ D n^^\ then we 

have Vf < Sf. By Lemma 4.7, k^^^ D R,^^^ D k^^^ with rj < Sj holds so long as Q does not 
appear. Let j° denote the coordinate of the column containing Q in row / — I. This means 

that both D K^-'"^ and D R^^°^ occur, and that we have a shrink on (/ — 

{f,j°)- By what we just saw, the first of these two conditions implies k^-'"^ D k,^^°\ since 
I is the bottommost possible row of these shapes. Consulting Theorem 3.4, we find no 

local rule which would produce the combination R^^"^-^^ D k^^°^ D k^^°^ at the cell {f,j°), 
which means that Q cannot appear earlier in row / — 1. Hence Q appears earlier in the 
/th row. 

Now we show that the x occur in increasing order in rows / — I and / by using Lemma 4.8. 
Since x cannot occupy the same column in both rows, it is enough to see that x cannot 
appear earlier (again from the right) in row / — 1. Continuing to denote by j° the column 
containing Q iii row / — I, let j ^ denote the column containing x in row / — I, and assume 

that x appears more to the left in row /. By definition of we have R'^^"'^^ C R^^°~^\ 
We also have a growth on (/ — — !)-(/, — 1), since Q has appeared earlier in 
row /. Since / is the bottommost possible row of these shapes, we are in the situation 
to start using Lemma 4.8, and we can continue to apply it until we reach the segments 
(/ — 2, j^)-(/ — 1, j^)-(/, j^). The occurrence of x at (/ — 1, j^) implies that we have 

both K^^^ C R^^^^ and R^^^~^^ C k^-'^^ The consequence of the repetitive apphction of 

Lemma 4.8 is that we also have r'^^'^^ C since row 1 is the uppermost row. Again 

consulting Theorem 3.4, we find no local rule which would produce the combination 

^O'^-i) (2 ^0'^) c K,^^'^\ Hence we must have x in the increasing order, as desired. 

□ 

Example 4.9. We show with an example how we can use Theorem 4.2 (and some argu- 
ments not included there) to recover the whole picture from P and Q. 

Suppose we are given a pair P and Q as in Remark 4.1. Using the symbols in Theorem 4.2, 
we have 1 — ^ — 171 — 2. Since P does not contain 2 and Q has a 2-shrink, we need to 
distinguish whether we are in the case (4) or (5). As prescribed in Theorem 4.2, we test 
the assumption that (7, 8)-(8, 8) is a shrink, so that P'-'^^ =22^- Working backwards, we 
obtain the cells in row 8 and the shapes on row 7 as in Figure 14. 

By (5), we can determine that this assumption is correct. 

To go up to the next level, we again find that / = 7 = m = 2 and that Q has a 2-shrink. 
Theorem 4.2 says that we again need a test, which fails this time producing a row with a 
nonempty leftmost segment: 

row 6^ 1 2 3 3 31 32 42 43 42 
row 7^ 1 2 2 21 22 32 33 32 
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Figure 14: The correct reverse correspondence 
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Hence we are forced to take P^^^ = 2 2 in Figure 14. 

In practice we can avoid the test in this case. If (6, 8)-(7, 8) was again a shrink, then Q 
in row 7 should occur to the left of column 7, where we have Q ^ow 8. This is for same 
reason as used in the proof of Theorem 4.2 after introducing Lemmas 4.7 and 4.8. For 
this to happen, we must have had a 2-shrink on grid row 7 to the left of the point (7, 6), 
but there was no such occurrence. 

We did not include this argument in Theorem 4.2 because we stuck to the rules only 

referring to the information in P and Q, and that are recursively applicable. This means 
that, after completing the grid row 7, we should only look at P^^-* and the up-down tableau 
on row 7, as if the initially given data was of order 7. 

To go up one more level. Theorem 4.2 imposes a test once again, but if we use the fact 
that row 6 was already in the 2-stratum, we immediately decide that (5, 8)-(6, 8) is a 
growth. Similarly for (4,8)-(5,8). 

For (3, 8)-(4, 8) we need a test, which succeeds as shown. Since there is no 1-shrink on 
row 3 to the left of Q ™ 4, we must switch to the 1-stratum for the remaining rows. 

An example of the full correspondence, which coincides with the example we give earlier 
by bumping is shown in Figure 15. 
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Figure 15: An example of the reverse correspondence 





X 

I 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 




I 


I 


I 


I 


I 


X 

2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 




1 


1 


1 


1 


1 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


X 

3 


3 






1 


1 


1 


X 

2 


O 


^ 


]^ 


I 


]^ 


]^ 


1 


1 


1 


1 


1 


1 


2 


2 




I 


I 


I 


I 


2 




I 


I 


X 

2 


2 


2 


2 


2 


2 


2 


2 


2 


O 

I 


I 




I 


I 


I 


I 


2 


I 


I 


I 


2 


2 


2 


2 


2 


X 


3 


3 


3 


2 


2 






1 


1 


1 


2 


1 


X 

2 


2 


21 


21 


21 


21 


21 


31 


31 


31 


31 


21 


21 




1 


1 


1 


1 


2 


1 


2 


2 


21 


21 


X 

31 


31 


31 


32 


32 


32 


32 


22 


22 




1 


1 


1 


1 


2 


1 


2 


2 


21 


21 


31 


31 


31 


32 


X 

42 


42 


42 


32 


32 




1 


1 


1 


1 


2 


1 


2 


2 


21 


21 


31 


31 


31 


32 


42 


X 
52 


52 


42 


42 




1 


1 


1 


1 


2 


1 


2 


2 


21 


21 


31 


31 


31 


32 


42 


52 


52 


42 


X 

52 




1 


X 

2 


2 


2 


21 


11 


21 


21 


O 

2 


2 


3 


3 


3 


31 


41 


51 


51 


41 


51 




1 


2 


2 


2 


21 


11 


21 


21 


2 


X 

3 


31 


31 


31 


O 

3 


4 


5 


5 


4 


5 




1 


2 


2 


2 


21 


11 


21 


21 


2 


3 


31 


31 


X 

41 


4 


41 


51 


51 


41 


51 




1 


2 


2 


X 

3 


31 


21 


22 


22 


21 


31 


311 


311 


411 


41 


411 


511 


511 


411 


511 




1 


2 


2 


3 


31 


21 


22 


22 


21 


31 


311 


X 

411 


421 


42 


421 


521 


521 


421 


521 


X 

1 


11 


21 


21 


31 


311 


211 


221 


221 


211 


311 


O 

31 


41 


42 


41 


411 


511 


511 


411 


511 


1 


11 


21 


X 
31 


32 


321 


221 


222 


222 


221 


321 


32 


42 


421 


411 


O 

41 


51 


51 


41 


51 


1 


11 


21 


31 


32 


321 


221 


222 


X 

322 


321 


331 


33 


43 


431 


421 


42 


52 


52 


42 


52 


1 


11 


21 


31 


32 


321 


221 


222 


322 


321 


331 


33 


43 


431 


421 


42 


52 


X 
62 


52 


53 



40 



5 Open Questions and Remarks 



Although the current pictorial viewpoint allows some additional insight into the workings 
of Berele's correspondence, it is not yet the major simplification that one could hope 
for. In particular the difficulty of running the algorithm backwards is still less than 
satisfactory. It would also be nice if Berele's correspondence could be seen as a particular 
case of some more general correspondence between pairs of up-down tableau and certain 
kinds of permutation-like objects. This is currently under investigation. 

The pictorial version of Schenstcd's algorithm is connected with a certain poset invariant 
due to Greene and Kleitman. It is a natural question to try to generalize this to the 
current case, but all efforts to date have failed. 
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